Skip to content

fix: numeric fields exporting as null in parquet export - #708

Merged
najuna-brian merged 1 commit into
OpenDataEnsemble:devfrom
najuna-brian:fix/numeric-export-null
Jul 31, 2026
Merged

fix: numeric fields exporting as null in parquet export#708
najuna-brian merged 1 commit into
OpenDataEnsemble:devfrom
najuna-brian:fix/numeric-export-null

Conversation

@najuna-brian

@najuna-brian najuna-brian commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Fixes #707. Numeric fields were casting to ::numeric in the export query, but lib/pq doesn't decode that type, so it came back as raw bytes and silently failed the float64 assertion in the parquet builder. Switched the cast to double precision, which lib/pq decodes as float64 directly.

@najuna-brian najuna-brian changed the title fix numeric fields exporting as null in parquet export fix: numeric fields exporting as null in parquet export Jul 30, 2026
casts to double precision instead of numeric, since lib/pq
doesn't decode numeric and was returning raw bytes, which
failed the float64 type assertion and got silently nulled.

fixes OpenDataEnsemble#707
@najuna-brian
najuna-brian force-pushed the fix/numeric-export-null branch from e18210d to 57e0875 Compare July 30, 2026 21:16
@najuna-brian
najuna-brian requested a review from r0ssing July 30, 2026 21:31
@najuna-brian
najuna-brian marked this pull request as ready for review July 30, 2026 21:32

@r0ssing r0ssing left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great catch!

@najuna-brian
najuna-brian merged commit 2d3b780 into OpenDataEnsemble:dev Jul 31, 2026
15 checks passed
@najuna-brian
najuna-brian deleted the fix/numeric-export-null branch July 31, 2026 07:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Numeric fields export as blank/NA in parquet exports

2 participants